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Abstract 



We show that non-dominated sorting of a sequence Xi,... ,X„ of i.i.d. random vari- 
ables in has a continuum limit that corresponds to solving a Hamilton- Jacobi equation 
involving the probability density function / of Xi. Non-dominated sorting is a funda- 
mental problem in multi-objective optimization, and is equivalent to finding the canonical 
antichain partition and to problems involving the longest chain among Euclidean points. 
As an application of this result, we show that non-dominated sorting is asymptotically 
stable under bounded random perturbations in Xi, . . . , X„. We give a numerical scheme 
for computing the viscosity solution of this Hamilton-Jacobi equation and present some 
numerical simulations for various density functions. 

1 Introduction 

Let Xi,. . ., Xn be i.i.d. random variables on with density function / G L^(M'^). The points 
form a partiahy ordered set Xn = {Xi, . . . , Xn} under the partial order 



Let i{n) denote the length of the longest chain^ in Xn, and for x G M let denote the 

length of the longest chain in Xn consisting of points less than or equal to x. We are interested 
in the asymptotic properties of as tt, — >■ oo. 

When / is a smooth density on [0, 1]'', hence £{n) = . . . , 1), the problem of studying 

the asymptotics of has a long history. It begins with Ulam's famous problem [44] of finding 
the length of the longest increasing subsequence of a random permutation. Hammersley [24] 
made some of the first breakthroughs in understanding Ulam's problem. He observed that 
the distribution of the longest increasing subsequence among n numbers chosen uniformly 
at random is the same as the distribution of i{n) for uniformly distributed points on [0, 1]^. 
Using subadditive ergodic theory, Hammersley showed that n~2i{n) converges in probability 
to a constant c as n — >■ oo, and he conjectured that c = 2. In subsequent papers, Vershik and 
Kerov [45] and Logan and Shepp [31] showed that c < 2 and c > 2, respectively. Hammerslcy's 
results were generalized by Bollobas and Winkler [6] to uniformly distributed points on [0, 1]*^; 
they showed that there exist positive constants Cd such that n~di(n) — )■ Cd almost surely as 
— 7- oo, and / e as d — t- cx). The only known values of are ci = 1 and C2 = 2. Deuschel 

chain is a totally ordered subset of X„. 




for i = 1, . . . ,d. 



(1.1) 



and Zeitouni [14] generalized Hammersley's results in another direction. For Xi,...,Xn 
i.i.d. on [0, 1]^ with density function / : [0, 1]^ — )• M, bounded away from zero, they showed 
that n~2^(n) — )• 2 J in probability, where J is the supremum of the energy 

J{(p)= [ \/ip'{x)f{x,(p{x))dx, 
Jo 

over all 93 : [0, 1] —t- [0, 1] nondecreasing and right continuous. 

There is another motivation for studying the asymptotics of tt„ that arises in multi- 
objective optimization problems. Such problems are of immense importance in many fields 
of science and engineering, including control theory and path planning [34, 30, 33], gene se- 
lection and ranking [41, 27, 26, 28, 17, 18, 19], data clustering [25], database systems [29, 37] 
and image processing and computer vision [35, 9]. In a discrete multi-objective optimiza- 
tion problem, one has several objective functions gi : S [0, 00), where i = l,...,d and 
S = {x^, . . . , x"} is a finite set, and is tasked with finding an element x €z S that minimizes 
all of the functions simultaneously. This is generally an impossible task, and instead, a family 
of solutions are obtained based on the notion of Pareto optimality. A feasible solution x & S 
is called Pareto optimal if for every y E S, we have gi{y) > gi{x) for some z, or giiy) = gi{x) 
for all i; in other words, no other feasible solution is better in every objective. The collec- 
tion of Pareto optimal elements is denoted Ti and called the first Pareto front. It is the 
most natural notion of solution for a discrete multi-objective optimization problem. If we set 
Xi = {gi{x^) , . . . , gd{x^)) € for i = 1, . . . ,n, then assuming all Xi are distinct, it is not 
hard to see that 

x' e Tx Un{Xi) = 1. 

The second Pareto front, T2, consists of the Pareto optimal elements oi S\Ti, and in general 

Tk = Pareto optimal elements oi S \ \^ J~^j- 

j<k 

The Pareto front that a particular feasible solution lies on is useful for ranking feasible solu- 
tions. As before, when the Xj are all distinct we have 

CC' G Tfc <S=^ UniXi) = k. 

This observation is essential. It says that studying the asymptotic shapes of the Pareto fronts 
J^i,J^2,--- is equivalent to studying the longest chain function Un- Figure 1(a) shows the 
Pareto fronts for n = 50 points uniformly distributed on [0,1]^, and Figure 1(b) shows the 
Pareto fronts for n = 10^ points. The points Xi that are on the same Pareto front are 
connected by a continuous staircase curve that represents the jump set of Un- 

In the multi-objective optimization literature, the process of computing the Pareto fronts 
for a collection of points is called non-dominated sorting [12]. In the combinatorics literature, 
the partition S = TiU • • • is called the canonical antichain partition [16] . Although we 
have described non-dominated sorting in the context of a discrete optimization problem, it is 
a fundamental tool in continuous optimization as well. Many state of the art algorithms for 
continuous optimization involve a large number of discrete subproblems, each of which requires 
non-dominated sorting. The most common examples are the so-called genetic and evolutionary 
algorithms for continuous multi-objective optimization [12, 20, 21, 11, 42]. The applications 
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(a) n = 50 points (b) n = 10^ points 

Figure 1: Examples of Pareto fronts for Xi, . . . X„ chosen from the uniform distribution on 
[0, 1]^. In (b), 29 equally spaced fronts are depicted out of the 1938 total fronts. 

of non-dominated sorting are not restricted to optimization; indeed, there are further striking 
apphcations in combinatorics [16, 32], molecular biology [38, 1], graph theory [32], Young 
Tableaux [46, 16] and even in physical layout problems in the design of integrated circuits [1]. 

The goal of this paper is to study the asymptotics of n„, and hence the asymptotics of non- 
dominated sorting. Our main result. Theorem 1, states that n~dUn converges almost surely 
to a continuous function U, which is the viscosity solution of a Hamilton-Jacobi equation. 
Our proof is based on linking the asymptotics of Un to a variational problem, which is a 
generalization of the variational problem discovered by Deuschel and Zcitouni [14] to higher 
dimensions. The Hamilton-Jacobi equation satisfied by U is the Hamilton-Jacobi-Bellman 
equation [3] for the corresponding variational problem. We describe our main result in Section 
1.1, and postpone the proofs to Sections 2 and 3. Although the proofs are technical, it is 
straightforward to derive the Hamilton-Jacobi equation via an informal argument, which we 
give in Section 1.2. In Section 4, we give a numerical scheme for computing U, and show 
simulation results comparing the level sets of U to Pareto fronts for various density functions. 

1.1 Main result 

For x,y E W^, we write x < y ii x ^ y and x ^ y. When < for z = 1, . . . , d, we write 

X < y, and we set = {x G M*^ : x > 0}. We will always assume d > 2. For s, t € M, s < t 
and s < t will retain their usual definitions. Let C M*^ and let / : M*^ — > [0, oo). We place 
the following assumptions on / and fi. 

(HI) There exists a continuous nondecreasing function m : [0, oo) [0, oo) satisfying m(0) = 
such that 

\f{x)-f{y)\<m{\x-y\), 
for x,y G il, and f{x) = for x ^ fi, 
(H2) O C M!| is open and bounded with Lipschitz boundary. 
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Set 

^= |7 G C\[0,1];R'^) : i {t) > for all t G [0,1]} . (1.2) 

Recall that 7' (t) > means that 7-(t) > for i = 1, . . . , d and 7' (i) 7^ 0. Define J : ^ ^ [0, 00) 
by 

^(7)= [' fm)Hm---m)'^dt, (i.s) 

Jo 

andU -.W^ by 

U{x) = sup J(7). (1.4) 

7e^;7(l)^a; 

We make the following definition. 

Definition 1. Given a domain O C W^, We say that a function u : O ^ R is Pareto- 
monotone if x ^ y =^ u{x) < u{y) for all x,y £ O. 

In Section 2, we show that [/ is a Pareto- monotone viscosity solution of the Hamilton- 
Jacobi partial differential equation (PDE) 

= 4/ on , , 




on lyjix.^. 

We note that / need only be Borel measurable, bounded and have compact support in 
for ?7 to be a viscosity solution of (1.5). The stronger assumption (HI) is only necessary 
for the proof of Theorem 1. The PDE (1.5) should be interpreted as the Hamilton- Jacobi- 
Bellman equation for the value function U. In Section 2.3 we prove a comparison principle for 
(1.5) which shows that U is the unique solution of (1.5) within a restricted class of viscosity 
solutions. Our main result is 

Theorem 1. Let f satisfy (HI), let Q satisfy (H2), and let Xi, . . . he i.i.d. with density 
f . Then there exists a positive constant Cd, depending only on d, such that 

— - 

lim \\n — CdU\\j^oc,(md\ = ^ a.s. 



The constants Cd are the same as those given by Bollobas and Winkler [6]. In particular, 
ci = 1, C2 = 2 and / e as d — 00. When / is a product density, i.e., f{x) = fi{xi) ■ ■ ■ fdixd), 
then (see Proposition 2) the value function U is given by 



^^""^ " (/< ^^^^ " ir ^'^^^ '^^y "' ^"^^^ ' ■ ^^'^^ 

For the case / = 1 and d = 2, Aldous and Diaconis [2, p. 204] provided a non-rigorous 
derivation of (1.5) by viewing the problem as an interacting particle process. They used this 
to motivate their proof that c = 2 in Ulam's problem, but make no rigorous statements about 
the relationship between (1.5) and the longest chain problem. A similar, though tangentially 
related, PDE also appears in growth models in multiple dimensions that are defined through 
the height of a random partial order [39, p. 209]. 
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Figure 2: Some quantities from the informal derivation of the Hamilton- Jacobi PDE for u. 

The connection between non-dominated sorting and solving a Hamilton-Jacobi PDE is 

intriguing, and potentially opens the door to fast algorithms for non-dominated sorting of large 
datasets. It also provides new tools with which to study the asymptotics of non-dominated 
sorting. As an example of the applicability of this result, we show in Theorem 9 that non- 
dominated sorting is asymptotically stable under bounded random perturbations in the data. 
This is a non-trivial result that follows easily from Theorem 1 and standard results on viscosity 
solutions. Another challenging problem concerns the convexity of the Parcto fronts. It is 
important to know when the Pareto fronts arc non-convex, as such situations pose significant 
problems for standard linear scalarization approaches to multi-objective optimization [15]. 
Macroscopic convexity of the Parcto fronts is asymptotically equivalent to quasiconcavity of 
U. Recall that U is quasiconcavc if the super level sets {x : U{x) > a} are convex for every 
a. Thus it would be interesting to classify density functions / for which U is quasiconcave. 
We plan to study these problems and others in a future work. 

1.2 Motivation 

It is fairly straightforward to derive the Hamilton-Jacobi PDE (1.5) using an informal argu- 
ment. Suppose / : R'^ — ;> R is continuous and n~dUn — > u uniformly for some u G C^{W^). Fix 
n large enough so that n^dUn ~ u. Then the k^^ Pareto front should be well approximated 
by the level set {y : u{y) = n~dk}. It is not hard to see that u should be Pareto-monotone 
(recall Definition 1), and hence it is reasonable to assume that > for all i. Fix x,v e'^'^ 
with {Du{x),v) > 0, where Du{x) denotes the gradient of u at x. Consider the quantity 
nd{u{x + v) — u{x)). This is approximately the number of Pareto fronts passing between x 
and X + v. When counting these fronts, we may restrict ourselves to the region 

A = {y : u{y) > u{x) and y x + v}. 

This is because any samples in {y : u{y) < u{x)} will be on a previous Pareto front and 
only samples that are less than x + v can influence the Pareto rank of x + v. See Figure 
2 for a depiction of this region and some quantities from the derivation. Since Ux^^x) > 
for all i, and u is C^, A is well approximated by a simplex for small \v\, and furthermore. 
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the samples within A are approximately uniformly distributed. Let m denote the number 
of samples falling in A. By scaling the simplex into a standard simplex, without disrupting 
the Pareto ordering within ^, it is reasonable to conjecture that the number of Pareto fronts 
within A is approximately cmd for some constant c, independent of x. For simplicity we take 
c= 1. 

By the law of large numbers, we have m ^ n f{y) dy. Hence when \v\ > is small we 
have ^ 

{u{x + v) - u{x)) K. j f{y)dy^ n'^\A\^ f {x)^ . (1.7) 

Let £i, . . . , denote the side lengths of the simplex A. Then \A\ ~ cii - ■ ■ for a constant 
c which we again take to be 1. Since x + v — iiCi lies approximately on the tangent plane to 
the level set {y : u{y) = u{x)}, we see that 

{Du{x),v — iiCi) « 0. 

Rearranging the above we see that ii Uxi{x)~^ {Du{x) , v) , and hence 

\A\ ^ u,,,{x)-' ■ ■ ■ u,^ix)-\Duix),v)'^. (1.8) 

For small we can combine (1.8) and (1.7) to obtain 

{Du{x),v) u{x + v) — u{x) « f{x)dUx^ ■ ■ ■ Ux^{x)~ d (^Du{x) , v) . 

Simplifying, we see that u should satisfy 

Ux,---Ux,- f = on (1.9) 

up to scaling by some constant. 

Although this derivation is informal, it is straightforward and conveys the essence of the 
result. It is difficult, however, to construct a rigorous proof based on these heuristics. There 
are two main reasons for this. First, it supposes that converges to a limit u, which is not 
obvious. Second, it is essential that u e C^, as we require A to be an approximate simplex. 
As we shall see in Section 4, solutions of (1.9) are in general not smooth, and can develop 
corners due to crossing characteristics. This is true even in the case that / is smooth, and is 
related to the geometry of the domain 



2 Analysis of variational problem 

Before studying the variational problem (1.4), we recall some aspects of the theory of optimal 
control [3] that are relevant to our problem. We will describe the infinite horizon optimal 
control problem, but the discussion below applies with minor modifications to other variants 
of optimal control, such as finite horizon or undiscounted problems with exit times. The state 
of the control problem, y{t), is assumed to obey the dynamics 

y'it)=giyit),ait)), t>0 

y(0) = x, ^ - ' 
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where a : [0, oo) — )■ ^ is the control, ^ is a topological space, and g : M*^ x A ^ M*^. Given an 
initial condition x G M'^, the solution of (2.1) is denoted yx{ )- Let 

A := {measurable functions [0, oo) A}. 

The goal in optimal control is to select the control a G .4 to minimize the cost functional 

J{x,a):= c{yx{t),a{t))e-^'dt, (2.2) 
Jo 

where A > and c : M"* x A ^ M. The value function for this problem is 

v{x) := inf J{x,a). (2.3) 

Under sufficient regularity assumptions on c and g (discussed below), the value function is a 
Holder- (or Lipschitz) continuous viscosity solution of the Hamilton-Jacobi-Bellman equation 

\v + H{x, Dv) = on M°', (2.4) 

where 

H{x,p) = s\x-p{-{g{x,a),p) -c{x,a)}. (2.5) 

Although the variational problem (1.4) can be cast in this framework, the assumptions 
on the running cost c(-, •) in the existing literature are too restrictive. For our variational 
problem, we have A = 0, g{x, a) = a, A = M^, 

c(x,a) = -/(x)5(ai---arf)^, (2.6) 

and U{x) = —v{x). In the proofs of Theorems 7 and 8, we require the standard optimal 
control theory to hold for / piecewise constant on arbitrarily small grids. In the standard 
reference on optimal control [3], it is assumed that x i->- c(x, a) is uniformly continuous. 
This assumption is then used to prove regularity of the value function v. There is relatively 
little research devoted to relaxing the regularity condition on c. There are some results for 
the optimal control problem associated with the Eikonal equation [36, 7, 13], which allow 
c to have discontinuities. These results assume that A = and make essential use of 
either Lipschitzness of f , or uniform continuity and/or coercivity of p i— t- H{x,p), none of 
which hold for the variational problem (1.4). Soravia [40] and Garavello and Soravia [22] 
considered a running cost of the form c{x, a) = ci{x, a) + C2(x), where ci is continuous and C2 
is Borel measurable, and showed that the standard optimal control results hold with minor 
modifications. This is incompatible with (2.6) when / is not continuous. A similar program 
is carried out for differential games here [23]. Barles et al. [4] study optimal control on 
multi-domains, where the discontinuity in c is assumed to lie in a half-space. 

Under the assumption that / is compactly supported, bounded and Borel measurable, 
the standard results on optimal control hold for the variational problem (1.4) with minor 
modifications to the proofs. In particular, in Lemma 1 we show that U is Holder-continuous 
with exponent ^, and in Theorem 2 we show that J7 is a viscosity solution of (1.5). The 
uniqueness of viscosity solutions of (1.5) under the assumption that / satisfies (HI) is a more 
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delicate problem. This is addressed in Section 2.3, where we show that U is the unique 
Pareto-monotone viscosity solution of (1.5) within a restricted class of viscosity solutions. 

In our main result, Theorem 1 we assume that / satisfies (HI), which is stronger than 
Borel-measurability. We assume Borel-measurability in much of this section so that our 
results apply to piecewise constant densities, which are used to approximate / in the proofs 
of Theorems 7 and 8. To be more precise, we set 

B = {f : / is bounded, Borel-measurable, and supp(/) C [0, 1]'^}. (2.7) 

We note that the assumption supp(/) C [0, l]'' is not restrictive, as we can make a simple 
scaling argument to obtain the case where / has compact support in M*^. We also note that 
Borel-measurability of / is necessary, as opposed to Lebesgue-measurability, to guarantee that 
the composition 1 1— )■ /(7(i)) is Lebesgue measurable. 

We now introduce some new notation. We will write 7 ^ a; whenever ^(t) ^ x for all 
t G [0, 1]. We write 71 ^ 72 whenever 71(1) ^ 72(0). The same definitions apply to <, <, ^, ^ 
and > with obvious modifications. For y G M*^ and r > we set Bj.{y) = {x eR'^ : \x—y\ < r}. 
For X, y G M'^ we set 

Jsup{J(7) : 7 G ^ and a; ^ 7 ^ ?/} if a; ^ y 
w{x,y) = <^ ^, . (2.8) 

10 otherwise. 

2.1 Basic properties of U 

We establish here some basic properties of U. Namely, in Lemma 1 we establish Holder- 
continuity of U, and in Lemma 2, we establish a dynamic programming principle for U. 

1 

Lemma 1. Let f E B. Then U is Holder-continuous with exponent ^ and [U]i < \\f\\f^oo(^-^dy 

Proof. Let x,z and let £ > 0. Choose 7 G .4 with 7 ^ x and J{'j) > U{x) — e. Since 

f{x) = for X ^ [0, l]'', we may assume that ^{t) G [0, 1]'' for all t G [0, ij. Set 

s = sup{t G [0, 1] : 7(t) S z}. 

If for all t G [0, 1] we have '~f{t) % z, then set s = 0. We claim that 

U{z) > U{x) - £ fm)Hj[{t) ■ ■ ■ iS))-' dt - e. (2.9) 
To see this: In the case that s > 0, we have 7(5) ^ z and hence 

u{z)> r fm)Hy,{t)---j',{t))Ut 

Jo 

= Jin)- [ fmf<i'iit)---iS))-^dt 

> U{x) - £ /(7(i))^(7i(t) ■ ■ •7d(t))^ dt-e. 
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In the case that s = 0, we have 



u{z) > = j(7) - fm)km ■ ■ ■ mf^ dt 



>u{x)- [' fm)Hm---m)'^ 

Jo 



d dt-e. 



Hence (2.9) is established. Suppose s < 1. Then there must exist i such that 7i(s) > Zi. It 
follows that 



Xi Zi 



7-(t) dt = 7i(l) - 7j(s) <Xi-Zi 
Applying the generalized Holder inequality we see that 

£ fm)km . . . mt'dt < mi^^^a^ m dty ... is) dt" ' 



<||/|ll^....b,;-z,:|a. 



Inserting this into 2.9 we obtain 



1 



1 1 1 



1 .. ..A . ,1 



Uix) - U{z) < \\f\\l^,^Ax, -z,\-d+e< \\f\\l^,^Ax -z\-d+e (2.10) 



If s = 1 then inspecting (2.9), we see that U{x) — U{z) < e, which implies (2.10). Sending 

1 ^ 

£ — >■ we find that U{x) — U{z) < ||/|| foomdJ^; — z\d. Since x,z are arbitrary, we can 



reverse their roles in the preceding argument to obtain the opposite inequality U{z) — U (x) < 

lloo(Kd)k-^|3- n 



Remark 1. By a similar argument, we can show that w -.W^ xW^ is Holder-continuous 

1 

with exponent 1/d and [w]i < ||/||^oo(Rd)- 

Lemma 2 (Dynamic Programming Principle). Let f & B. Then for any r > and y G M'^ 
we have 

U{y)= max {U{x) + w{x,y)}. (2.11) 

Proof. Let us denote the right hand side of (2.11) by v(y). We first show that U{y) < v{y). 
Let £ > and let 7 G ^ such that 7 ^ y and J{^) > U{y) — e. Suppose that [7(1) — y\ > r. 
Then there exists x G dBr{y) such that 7(1) ^ a; ^ y and hence 

U{y) < J{-i) + e< U{x) + e< v{y) + e. 

If 17(0) — y\<r then there exists x G dBr{y) such that x <j < y and hence 

v{y) > w{x,y) >J{j)> U{y) - e. 
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Finally, suppose that |7(1) — y\<r and |7(0) — y\ > r. Then there exists < s < 1 such that 
— y\ = r. Set X = 7(5) and define 7^,7^ G ^ by 

j^{t) = j{st) and 7^(i) = 7(5 + t{l - s)) for t G [0, 1]. 

Note that 7^ ^ a; and x ^ 7^ ^ y. Since J is invariant under a change of parametrization of 
7, we see that 

U (y) < J(7) + e = J(7^) + 7(7^) +e< U{x) + w{x, y) + e < v{y) + e. 

Sending e — > we obtain U (y) < v{y). 

We now show that U{y) > v{y). By Lemma 1 and Remark 1, there exists x G dBr{y) 
with X < y such that 

v{y) = U{x) + w{x,y). 
Let £ > and let 7-*^ , 7^ G .4 with 7^ ^ x and x ^ 7^ ^ y such that 

J(y ) > Uix) - I and J(7') > «;(x, y) - |. 

Since 7''^ ^ 7^ ^ y, we can concatenate 7^ and 7^ to find that U{y) > J{'J^) + J{j^)- Thus 
we have 

U{y) >U (x) + w{x, y) - £ = v{y) - e. 
Sending £ ^ yields U{y) >v{y). □ 

2.2 Hamilton-Jacobi-Bellman equation for U 

We digress momentarily to recall the definition of viscosity solution of 

H{Du) = f on O, (2.12) 

where O C M'^ is open, i7 : M'' ^ M is continuous, / : O ^ M is bounded, and u : O ^ M. 
is the unknown function. For more information on viscosity solutions of Hamilton-Jacobi 
equations, we refer the reader to [3]. The superdifferential of w at x G C, denoted D~^u{x), is 
the set of all p G M*^ satisfying 

u{y) < u{x) + {p,y-x) + o(|x - y\), as O 3 y ^ x. (2.13) 
Similarly, the subdifferential of u at x G O, denoted D~u{x), is the set of all p eW^ satisfying 

u{y) > u{x) + {p,y — x) + o(|x — y\), as O 3 y ^ x. (2-14) 
Equivalently, we may set 

D'^u{x) = {Dip{x) : if G C^{0) and u — (p has a local max at x}, 

and 

D~u{x) = {D(p{x) : (p G C^{0) and u — (p has a local min at x}. 



10 



Definition 2. A viscosity subsolution of (2.12) is a continuous function u : O ^ R. satisfying 

H{p) < f*{x) for all X G O and p G D+u{x). (2.15) 

Similarly, a viscosity supersolution of (2.12) is a continuous function n : O — )■ M satisfying 

H(p) > f*{x) for all x G C and p G D-u{x). (2.16) 

The functions /* and /* are the lower and upper semicontinuous envelopes of /, respectively, 
defined by 

f*{x) = limsup{/(y) : y & O and \x — y\ < r}, 

and /* = —(—/)*. If u is a viscosity subsolution and supersolution of (2.12), then we say that 

is a viscosity solution of (2.12). 
After a basic proposition, we establish in Theorem 2 that ?7 is a Pareto-monotone viscosity 
solution of (1.5). 

Proposition 1. Let O C M'^ 6e open and let v : O be continuous and Pareto-monotone. 

Then 

D+v{x)UD-v{x) C 

for all X eO. 

Proof. Let x G O and p G D^v{x). For any index i and small enough t > 0, we have 
X X + tei e O. Since v is Pareto-monotone, we have 

v{x) < v{x + tci) < v{x) + Pit + o{t), as t\ 0. 

Hence pi > o{t)/t as t \, which implies that pi > 0. The proof for D~v{x) is similar. □ 

Theorem 2. Let f E B. Then the value function U defined by (1.4) is a Pareto-monotone 
viscosity solution of the Hamilton- Jacobi equation 

U,,---U,, = ^f on M.''. (2.17) 

Furthermore, U satisfies 

(i) Whenever supp(/) C {x G M*^ : ^ x ^ z}, we have 

U (xi, . . . , Xfi) = U (min(xi, zi), ■ ■ ■ min(X(i, Zd)) for all x G M!|_, 

(ii) U{x) = for every x G M*^ \ 

Proof. It follows immediately from the dynamic programming principle (Lemma 2) that U is 
Pareto-monotone, and (ii) follows from the fact that supp(/) C [0, l]''. 

For (i), let z £ R'^ such that supp(/) C {x G M'^ : ^ x ^ z} and let x G M'f such that 
Xi > Zi for some i. Set x = (min(xi, zi), . . . , min(xd, 2;^)). Since U is Pareto-monotone we 
have U{x) < U{x). Let £ > and 7 G ^ such that 7 ^ x and U{x) < J{-f) -\- e. Let 

s = sup{i : 7(i) ^ x}. 
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If for all t £ [0, 1] we have j^t) % x, then set s = 0. If s = 1, then 7^2; and hence 
U{x) < J(7) + £ < U{x) + £. If s = then for every t G [0, 1], 7(i) supp(/), and hence 
J{j) = 0. It follows that 

U{x) < J{-i) +e = e< U{x) + e. 

If < s < 1, then for any t > s, '^i{t) > Zi for some i, and hence f{'y{t)) = 0. Set 7^(t) = j{st) 
for t G [0, 1]. Then -f^ £ x and J{-/) = J{-f'^), hence U{x) < J{-f) + e = J(7^) +£ < U{x) + e. 
Sending e ^ we see that U{x) < U{x) and hence U{x) = U{x). 

We now show that U is a viscosity supersolution of (2.17). Let y G M*^, let a G M!|., and 
set j{t) = y — a{l — t). By Lemma 2 we have 

/I 
f{y-a{l-s))-i{ai---aa)-dds 

> U{y - a{l - t)) + (1 - t)f4y){ai ■ ■ ■ aa)'^ + o{l - t) as t r 1. (2.18) 
Let p G D~U (y). Since y — a(l — t) — >• y as i / 1, we have 

(2.14) 

{p,{l-t)a) > Uiy)-U{y-a{l-t)) + o{l-t) 

(2.18) 1 

> {l-t)f4y){ai---ad)-^ +o{l-t) as t / 1. 

Sending t / 1 we obtain 

(p,a) > /*(2/)3(ai • • •ad)^. 
Since a > was arbitrary, we obtain 

sup|-(p,a) + /,(y)^ (01 •• •arf)H <0. (2.19) 

Since U is Pareto-monotone, Proposition 1 yields p > 0. Hence if /* (y) = then U is trivially 
a viscosity supersolution of (2.17) at y. We may therefore suppose that f*{y) > 0. Fix i and 
set Uj = 1 for J / i. By (2.19) we have 



sup < 

Oi>0 



+ aff^{y)d - aipi ^ <Q. 



Since flj can be arbitrarily large, we must have > for the above to hold. Substituting 
= p^^ into (2.19) and simplifying we obtain 

Pi---Pd> 

Thus J7 is a viscosity supersolution on M'^. 

We now show that U is a viscosity subsolution of (2.17). Let y G M*^, let e > 0, and let 
p G D~^U{y). By Lemmas 1 and 2 and Remark 1, for every r > there exists x G dBr{y) 
with x < y such that U{y) = U (x) + w{x,y). Hence there exists 7 G .4 with x ^ 7 ^ y such 
that ^ 

U{y)< [ fi^{t))H-f[it)---j'dit))Ut + Uix) + er. 
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By Holder's inequality 



U{y) - U{x) < C f{7{t))kl'iit) ■ ■ ■ 7^(i))^ dt + er 
Jo 



1 X ^ / .1 \l 



<{r{y)-^+o{l))^J^mdtj •••^7^(t)dtJ +er 

< - yi\^ ■ ■ ■ \xd-yd\^ +o{r) + er, 

as r V 0. Since x ^ y as r \, 0, we have 

(2.13) 11 1 

{p,y-x) < U{y)-U{x) + o{r) < f*{y)d\xi-yi\d ■■■\xd-yd\^ +o{r)+£r, 
as r V 0. Choose r > small enough so that o{r)/r < e, and set a = {y — x)/r. Then we have 

-{p,a) + f*{y)'d{ai---ad)-d > -2e. 
Since e > was arbitrary, we see that 

sup |-(p,a) + /*(y)^(ai---ad)H > 0. 

o>0:|a|=l 

Since U is Pareto- monotone, we have p > 0. If = for some i, then pi ■ ■ - pd ^ f*{y)/d'^- 
Thus we may assume that > for all i. Then the supremum above is attained at some 
a > with \a\ = 1. By scaling a so that ai • • • = 1, we see that 

sup {-(p,a) + r(y)H >0. (2.20) 

a>0:ai---ad=l 

Since Pi > for all i, we have that 

limsup —{p,a) + f*{y)d = — oo. 

|a|->oo, a>0 

It follows that the supremum in (2.20) is attained at some a* > 0. Introducing a Lagrange 
multiplier A > 0, the necessary conditions for a* to be a maximizer of the above constrained 
optimization problem are 

Pi = for alH G {1, . . . , d} and • • • = 1. 
It follows that X = {pi- ■ •pd)d and = p^^{pi • • -Pd)^ ■ Substituting this into (2.20) we have 

Remark 2. We remark that U satisfies an important truncation property. Namely, if we fix 
z G and define UJ-.W^^Rby 

U{xi,...,Xd) = U{mm{xi, zi), . . . ,m.m{xd, Zd)) 
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m 

then we have 



f*{x) X ^ z 

otherwise, 



C/xi • • • f/x, = / on 

in the viscosity sense. Indeed, this follows directly from Theorem 2 by noting that supp(/) C 
{xeR'^ : OSx^z} and 

U{x)= sup C Kl{t))-^{l[{t)---iS))~'dt. 



2.3 Compcirison principle 

As in the theory of optimal control, we would like to establish that U is the unique viscosity 
solution of (1.5). The difficulty here comes from the hypothesis (HI). The standard results on 
uniqueness of viscosity solutions [3, 10] assume uniformly continuous dependence on spatial 
variables. There has been some recent work relaxing this condition, as it is important in many 
applications. Tourin [43] considered Hamilton-Jacobi equations of the form H{x,Du) = 0, 
where x i— t- H{x,p) is allowed to have a discontinuity along a smooth surface, and proved 
a comparison principle under the assumption that p i— H{x,p) is convex and uniformly 
continuous. Neither assumption holds for (1.5), although the non-convexity can be easily 
remedied. Deckelnick and Elliot [13] prove a comparison principle for Lipschitz viscosity 
solutions of Eikonal-type equations of the form H{Du) = f, where / satisfies a regularity 
condition similar to (HI), but slightly more general. As exhibited by the solution U{x) = 
(xi---Xd)d of (1.5) for / = 1, solutions of (1.5) are not in general Lipschitz continuous. 
Camilli and Siconolfi [8] proposed a new notion of viscosity solution for Hamilton-Jacobi 
equations of the form H{x, Du) = 0, where H is only assumed to have measurable dependence 
on the spatial variable x. They obtain general uniqueness results under the assumption that 
p !-)• H{x,p) is quasiconvex and coercive. Their results do not apply to (1.5) due to the 
coercivity assumption. 

In this section we establish two comparison principles for continuous viscosity sub- and 
supersolutions of (1.5), under different regularity conditions on /. The first comparison 
principle. Theorem 3, assumes that / : M^^. — )• M is uniformly continuous and applies to the 
broad class of Pareto-monotone viscosity sub- and supersolutions. In the second comparison 
principle. Theorem 4, we allow / to have a controlled discontinuity: We assume that / is 
uniformly continuous on a bounded open set 0, with Lipschitz boundary, and that / vanishes 
off of ri. This is summarized in hypotheses (HI) and (H2). In this case, we can only obtain a 
comparison principle within the class of truncatable viscosity subsolutions, as per Definition 
3. As pointed out in Remark 2, the value function U is truncatable, so this result is applicable 
in the proof of Lemma 3, which is essential to our main result. 

Theorem 3. Suppose f : -^R is uniformly continuous with supp(/) C [0, 1]*^. Let u and 

V be viscosity sub- and supersolutions, respectively, of 

Ux,---u^, = f on M^, (2.21) 

and suppose that 

u{x) = 'u(min(xi, 1), . . . , mm{xd, 1)) for x G R'l, (2.22) 
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and V is Pareto-monotone. If u < v on SMl then u < v on 



The proof of Theorem 3 utihzes the method of doubhng the variables, which is standard in 
the theory of viscosity solutions [3] , with appropriate modifications for the boundary condition 
(2.22). 



Proof. For 9 > 0, set V0{x) = v{x) + 9d {x, 1^), where 1^ = (1, . . . , 1) G M*^. Fix a; G and 
p G D~vg{x). It is easy to see that p — 9dl^ ^ D~v{x). Hence we have 



(jp^-e-d)---{pd-e-d)-f{x)>Q. 

Since v is Pareto-monotone, we have pi — 9^ > for all i, and therefore 

Pi---Pd = {pi-0-d +9-d)---{pd-9-d +9-d)>{pi-9-d)--- {pd -9-d) + 9> fix) + 9. 
Hence is a viscosity supersolution of 

ve,xi ■■■ve,xa = f + Q on 

and u <vq on dRi^. 

Suppose that 5 := supj^d — vg) > 0. For x, y G M'|_ and a > 0, set 

^a{x, y) = u{x) - ve{y) - q\x - y\^, 
and Mq = supjgd ^jjd (u — -yg). Setting x = y in $Q,(x,y) we see that > 5 > for all a. Let 
x = (min(xi, 1), . . . ,min(xd, 1)) and y= (min(yi, !),••• ,min(yd, !))• 

Note that |x — y| < |x — ?/|, u{x) = u{x) (by (2.22)) and V0{y) < V0{y) for all x,y G M*^. 
It follows that ^a.{x,y) > ^a{x,y), and hence attains a maximum at some {xa,ya) G 
[0, 1]^ X [0, 1]"=^. Since Ma > 6, we have 

u{xa)-ve{ya)>S + a\xa-ya\'^- (2-23) 
It follows that ^ 

\Xa -ya\< (ll'"llLo°((0,l)d) " ""^(0)) ■ (2.24) 

Since n < v^* on 5R^[ and (x, y) u{x) — vg{y) is continuous, it follows from (2.23) and (2.24) 
that (xq, ya) G (0, l]'^ x (0, 1]'' for a large enough. For such a we have p := 2a{xa — ya) G 
D~^u{xa) n D~V0{ya), and hence 

Pi---Pd< f{xa) and pi---pd> f{ya) + Q- 

Subtracting the above equations yields f{xa) — f{ya) > ^) which contradicts the uniform 
continuity of / and (2.24) as a — >■ oo. Therefore u < vo on M^. Sending 9^0 completes the 
proof. □ 

We can prove a comparison principle for discontinuous / by assuming that the subsolution 
satisfies the truncation property described in Remark 2. For this, we make the following 
definition. 
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Definition 3. Let u be a viscosity subsolution of 



U:c,---Ua,a = f on (2.25) 
We say that u is truncatable if for every z G W^, u is a viscosity subsolution of 

Uxi ■■■Uxa = f on R'l, 
where u and f are defined in Remark 2. 

We note that that truncatabihty is well-defined, i.e., it depends only on /*. By Remark 
2, the value function U is truncatable. It is easy to see that every Pareto-monotone 
subsolution of (2.25) is truncatable, and we suspect that every continuous Pareto-monotone 
viscosity subsolution (2.25) may be as well, but are not able to prove this. As we show below, 
in the case that / G L°°(M^) is a product density, the expression for u given by (1.6) is 
truncatable, even though u is not in general C^. 



Proposition 2. Let f G L°°(M^) such that / = /i • • • /d where fi G -L°°((0, oo)), and / > 0. 
Then u : Ml M given by 



<x)= / f{y)dy\ (2.26) 



is a Pareto-monotone truncatable viscosity solution of 



Uxi---Uxd = jdf on 
u = on 



(2.27) 
+ • 



Proof. It is obvious that u is Pareto-monotone and u = on d'K'^. The fact that u is 
truncatable will follow immediately from the expression (2.26) for u, once we show that u is 
a viscosity solution of (2.27). 

Let X G M^. Throughout the proof, we will set zj = (J|^^ fj{t)dt)^, so that u{x) = 
z\ - ■ ■ Zd- We split the proof into two cases. 

Case 1. Suppose that u{x) = 0. Then we must have /*(.'c) = 0. Since u is Pareto- 
monotone, we have by Proposition 1 that D~ u{x)\J u{x) C M^j.. Thus, for any p G D^u{x) 
we have • • - Pd > = f^{x)/d'^. Let p G D'^u{x). Then we have 

'u{y) < u{x) + {p,y — x) + o{\y — x\) as y ^ x. 

Since u is Pareto-monotone and « > 0, we have u(y) = u(x) = for all y ^ x. For any i we can 
set y = x—tci to obtain ^ <Pit < o{\t\) as t \ 0, and hence = andpi • • -pd = < f*{x)/d'^. 

Case 2. Suppose that u{x) > 0, and hence zj > for all j. Let p G D'^u{x). Fix i and set 
y = X — tci. Then we have 

u{x — tei) < u{x) — Pit + o{\t\) as t — )■ 0. 

Substituting the definition of u we have 

p-tK^im^ ( ( r f.^s)ds]' - ( r 'fi{s)dsY] +o{\t\) ast^O. 
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Applying a Taylor expansion to the term in brackets, we obtain 
zi---Zd I 1 



Pit < 



d 



Ms)ds 







/ -Jxi-t 



s) ds + o 



fi{s) ds 



Xi t 



+om) 



= ^u{x)z.''£ji{s)ds + o{\t\) 



<-u{x)z-''{ft{x,)t + o{\t\))+om), 
as t \, 0. It follows that pi < ^u{x)z^'^f*{xi) for all i and hence 

Pi---Pd< ^u{x)M^)-''mxi) ■ ■ ■ fA^d) = ^fix) 

Let p G D~u{x). We again set y = Xi — tsi for fixed i and find that 
zi---Zd I 1 



Pit > 



d 



fi{s)ds 



^-1 



fi{s)ds + o 



Xi t 



Ms) ds 



Xi t 



+om) 



> -u{x)zr'' {Mxi)t + oi\t\)) + o{\t\), 



as t \, 0. As before, we conclude that Pi ■ ■ ■ Pd > ^f*{x)- □ 
We place the following assumption on / : M'^ — ^ [0, oo) and J7. 

(HI) There exists a continuous nondecreasing function m : [0, oo) — )• [0, oo) satisfying m(0) = 
such that 

\f{x)-f{y)\<m{\x-y\), 
for x,y e CI, and f{x) = for x ^ 

(H2) Q, C is open and bounded with Lipschitz boundary. 

In particular, since O is open (HI) implies that / = /* on M^. The assumptions on U imply 
that the following cone condition is satisfied. 

(H2*) For every x G 90, there exists a cone Kx with nonempty interior and a neighborhood 
Vx of x such that 

yeVx\n =^ {y + }Cx)nUnVxC {y}. 

To see this: For any x G dQ there exists, by Lipchitzness of dQ, r > and a Lipschitz 
continuous function "if : M*^"^ M such that, upon relabelling and reorienting the coordinate 
axes if necessary, we have 

n n Brix) = {ye Br{x) : yd < *(yi, • . . , yd-i)}- 

One can check that the cone 

}Cx = {yeW'^:yd> 2Lip(*)^y2 + ---y2_J 

satisfies (H2*). As it is more useful in the comparison principle proof, we will assume that 
(H2*) holds instead of Lipschitzness of the boundary. We note that the cone condition (H2*) 
is the same as the one used by Deckelnick and Elliot [13, p. 331]. 
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Theorem 4. Suppose that satisfies (H2*) and f satisfies (HI). Let u and v be viscosity 
sub- and supersolutions, respectively, of 

ux^---u^a = f on M^, (2.28) 

and assume that u is truncatable and v is Pareto-monotone. Then u < v on dMi_ implies that 



u < V on R'i^. 



As in the proof of Theorem 3, the proof below is based the standard technique of doubhng 
the variables [10]. The proof is similar to [13, Theorem 2.3] in the way that (H2*) is used, 
however, we cannot assume Lipschitzness of v. The truncatability condition on in a sense 
replaces the Lipschitz condition on v in [13, Theorem 2.3]. 



Proof. For 9 > 0, set vg{x) = v{x) + 6<i(^x, 1^) + 6. Then u < on 5M5J[_. As in the proof of 
Theorem 3, vg is & viscosity supersolution of 

V0,a^,---vg,,, = f + e on M^. (2.29) 

Now suppose that supj^d (u — vg) > and let 

R = sup l^^r > : u<vg on n 5^(0)} . 

Since u < vg on 9R'J_ and u — vg is continuous, we see that < i? < oo. By the definition 
of R, there exists zq G dBji{0) n M!^ such that u{zo) = vg(zo) and every neighborhood of zq 
contains a point y such that u{y) > vg{y). For r > set 

H = {xGR'^ : zo-rld<x <zo + r'^la}. 

and note that sup jj{u — fg) > for any r > 0. 

Notice that we may assume (H2*) holds at any x G M^|_. Indeed, if a; (90 then we may 
set Vx = Bcr{x) and choose a > small enough so that 50 CiVx = 0. Then any cone Kx will 
suffice as either Vx\^ = oi VxOQ = 0. Let 77 G S'^~^ be in the interior of ICzq ■ For x G 
set 

u{xi, ...,Xd)= u(min(a;i, zq^i + r^), . . . , min(xd, zo^d + r"^))- 
For a > and (x, y) G x set 

^a{x, y) = u{x) - vg{y) - a 



1 

X — y i=r] 



and Mq, = supjgd ^jjd By continuity of u and vg we have 



(2.30) 



£ := lim inf > sup(S - vg) > 0. (2.31) 

a^oo 

Set 

D = {x e M'^[, : Xi < ZQ^i — r for some i}. 
Let X e D such that x ^ zq + r^ld. Then there exists i such that Xi < zq^i — r and we have 

\x\^ < {zo,i - rf + ^(zoj + r'^f = \z\'' - 2zo,ir + 0{r^). 
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Since |z| = i? and z^^i > 0, we can choose r > small enough so that x G Bji(0) and hence 
u{x) < vq{x) for any x & D with x ^ zq + r^l^. Fixing such an r > we have 



u<ve on Dn{x eWl : x ^ zo + r^l^}. 



(2.32) 



Since u and vg are uniformly continuous on compact sets, it follows from (2.32) that there 
exists 6 > such that 



u{x)-ve{y) < -, 



D 3 X zq + r^ld and \x — y\ < 6 = 
for every x,y e M^. Now let x G D and y G with \x — y\ < 6, and set 



x = (min(a;i, 2:0,1 +r'^),---, min(a;rf, zo,d + r^)) 
y= (min(yi,2;o,i + r'^), . . . ,mm{yd, zo^a + r^))- 

Then x & D, x ^ zo + r'^ld, \x — y\ < \x — y\ < 6, u{x) = u{x) and VQ{y) > vq{ 
that 

u{x) - vg{y) < u{x) -ve{y)< -. 



We conclude 



Hence we have shown that for any x, y G M^j. 

X G -D and \x — y\ < S 



u{x)-ve{y) < -. 



Fix a > large enough so that Mq, > e/2 and let (x, y) G 
e/2. Then we have 



(2.33) 

such that $a(x, y) > 



u{x) — v{y) — a X — y 
In particular, we have u{x) — vo{y) > |, and 

1 

\x-y\< 



1 



a 



> 



+ 1 



^llL°°(Md) -^e(O) 

Taking a large enough so that |x — y| < 6, we see from (2.33) that x ^ zq — rid- Now set 

X = (min(xi, 2:0,1 + r^), . . . , min(X(i, 2;o,(i + r"^)), 

and y = y + x — X. Then we have xE:H,x — y = x — y, u{x) = u(x), and ^^^(y) < ve{y). It 
follows that <&a(x, y) > ^^(x, y). Hence for a > large enough, $q, attains a global maximum 

at (xq,, ya) G M"[_ x M^^ satisfying Xa € H and |xq — y^l < C j \foL. 

Sending a — >• 00 and extracting a subsequence, if necessary, we may assume that 

Xq — >■ xo and ya — >■ xo as a — >■ 00, 

for some xo G R. Since 

S(xo) - ve ( Xo ^r? j < Ma < u(xa) - 'ye(ya), 
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we see, by the continuity of u and vq, that 



hm Ma = u{xo) - V0{xo). 

a— >-oo 



It follows that 



a 



a 



as a ^ oo. (2.34) 



Let 

p = 'la\Xo,-yoc 1=^ 



la 

Since (x^, ya) G ^% x is a local max of we have ■p G D'^u{xa) n D~vo{ya)- Since u is 
a truncatable, we have 

Pl---Pd<{f )*{Xa) < f*{Xa), 

where f{x) = f*{x) for x ^ zq + r^ld and f{x) = otherwise. By (2.29) we have 

Pi---Pd > f*{ya) + d- 

Combining these we see that 

f*{x^)- My^)>d. (2.35) 

If xq d^l, then for a large enough we have either Xa, G O or Xa, Va G 1^+ \ ^- Hence 
by (HI) we have 

f*{Xa) - f*{ya) <m{\Xa-ya\)- (2-36) 

Suppose now that xq G 0^2. We have two cases; either (1) G or (2) G \ 

Case 1. In this case we have f*{ya) = f{ya)- If G then f*{xa) = f{xa) and hence 

(2.36) holds. If Xa G \ n then /*(xa) = and (2.36) holds trivially. 
Case 2. Set Wa = Xa — ya ~ aiid note that 



By (2.34) we have y/awa — >■ as a ^ oo. Since rj is in the interior of /C^g, we see that 
77 + ^/aWa G ICz„ for a large enough, and hence G ya + /C^g. We can take r > smaller, 
if necessary, so that H G Vz(, . Since .Tq G ii/, wc can choose a large enough so that y„ G V^,,- 
Since Xa 7^ ya for a large enough, wc have by (H2*) that Xa G \ O and hence f*{xa) = 
and (2.36) holds. Sending a ^ in (2.36) contradicts (2.35), hence u < vq on W^. Sending 
e^Owe find that n < i; on M^. □ 

In order to prove our main theorem, we require a general perturbation result that includes 
certain types of perturbations in the density. We can obtain such a result from the 
comparison principle proved in Theorem 4. We first recall some notation standard in the 
theory of viscosity solutions. For a sequence of bounded functions fn : — )• M, the upper 
and lower limits are defined by 

limsup* fn{x) := lim sup < /„(y) : n> j, y G M*^, and |x - y| < ^ 

and 

1 



liminf* fn{x) := lim inf <^ fn{y) : n>j, y G M , and |x - y| < 
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Lemma 3. Let {fn}^=i C B and suppose that satisfies (112*), f satisfies (HI), and 

/* < liminf* /„ and limsup* fn < f*- (2.37) 

n— >oo n— >oo 

For each n, set 

/.I 

Vn{x)= sup / fn{l{t))-^{.il{t)---iS))~'dt. 

Then Vn ^ U uniformly where U is the value function given by (1.4). 

Proof. Wc claim that {fn}^=i is a uniformly bounded sequence. To see this, suppose to the 
contrary that there exists a sequence Xn in [0, 1]"^ such that fn{xn) — )■ cjo as n — )■ 00. By 
passing to a subsequence, if necessary, we may assume that x„ — >■ xq G [0, 1]^ as n ^ 00. By 
the definition of the upper limit and (2.37), we have 

f*{xo) > limsup* /n(a;o) = 00, 

n— >-oo 

which contradicts the assumption that / satisfies (HI) and establishes the claim. 

Since {fn}'^=i is uniformly bounded, there exists (by Lemma 1) a constant C such that 
[vn]i < C for all n. The sequence v„ is therefore bounded and equicontinuous, and by 

d 

the Arzela-Ascoli theorem there exists a subsequence Vn^. and a Holder continuous function 
V : M*^ ^ M such that Vn^. -> v uniformly in M'' as A; — >■ 00. By Theorem 2, each Vn is a 
Pareto-montone truncatable viscosity solution of 

Vn,xi ■ ■ ■ Vn,xa = °^ 

By standard results on viscosity solutions (see [10, Remark 6.3]) and (2.37), we have that v 
is a Pareto-monotone viscosity solution of 

Vx,--- = on M^. 

By the assumption that supp(/„) C [0, 1]'^, we have that Vn{x) = for all x ^ M^, hence 
v{x) = for ah x ^R^. 

We claim that v is truncatable. To see this, fix z G M^J. and define v, Vn, f and /„ as in 
Remark 2. Since Vn is truncatable, Vn is a viscosity solution of 

Vn,xi ■ ■ ■ Vn,xd = 

By the definition of /«, we have fn < fn-> with fn{x) = /^(x) for x ^ z. li follows that 
limsup* fn{x) < limsup* /^(x) < /*(x) = /(x) = (/ )*(x) for x ^ z. 

n— >oo n— >oo 

For X % z, there exists a neighborhood F of x on which is identically zero for all n. It 
follows that 

limsup* /„(x) = = (/)*(x). 
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and therefore limsup* /„ < (/)*. Since Vn,. — ^ v uniformly, we can again apply standard 
results on viscosity solutions [10] to find that ?; is a viscosity subsolution of 

Vx,---Vxa = on M^, 

which proves the claim. 

By Theorem 4 we have v = U on M^. Since U{x) = ■u(x) = for x ^ we have v = U 
on M*^. The above argument can be used to show that every subsequence of Vn contains a 
uniformly convergent subsequence converging to U. It follows that Vn U uniformly in M'' 
as n — )• oo. □ 



3 Large sample asymptotics of Un 

The proof of Theorem 1 is split into several steps. In Section 3.1, we prove a basic convergence 
result for piecewise constant density functions, which is a generalization of the results of 
Deuschel and Zeitouni [14]. In Section 3.2, we extend the convergence result to densities that 
are continuous on and vanish on M"^ \ O by considering a sequence of piecewise constant 
approximations to /, applying the results from Section 3.1, and passing to the limit. This 
requires a perturbation result for the energy J, which we obtained from the comparison 
principle for the associated Hamilton-Jacobi PDE (1.5) in Lemma 3. 



3.1 Piecewise constant densities 

We aim to prove a basic convergence result for piecewise constant densities here. The proof is 
split into a lower bound. Theorem 5, and an upper bound. Theorem 6. Wc should note that 
the techniques used here are similar to those used by Deuschel and Zeitouni [14], who showed 
the same convergence result for smooth densities bounded away from zero in dimension d = 2. 

Let us introduce some notation. For a finite set S C M*^, let £{S) denote the length of the 
longest increasing chain in S. The set function £ has an important invariance. If ^' : M"* — >■ M*^ 
is a mapping that preserves the partial order ^, i.e., x ^ y ^(x) < ^{y), then 

e{S) = £{^{S)) for any S C R'^. (3.1) 

For ^ C M*^ we denote by XA : M'^ — )■ R the characteristic function of the set A, which takes 
the value 1 on ^ and on M"^ \ A. When A is Lebesgue measurable, we denote by |^| the 
Lebesgue measure of A. We set 0^ = (0, . . . , 0) G and 1^ = (1, . . . , 1) G M*^. Given an 
integer L, wc partition [0, l)'^ into hypercubes of side length 1/L. More precisely, for a 
multiindex a G with || 

'-'^lloo ^ where ||q;||oo — max(Q!i, . . . , ct^,), we set 

QL,a = {xe [0, l)"^ : a-ld^Lx< a}. (3.2) 

We say that / : [0, l)'' — >■ [0, oo) is L-piecewise constant if / is constant on QL,a for all a. It 
follows that if / is L-piecewise constant then / is A;L-piecewise constant for all G N. For 
convenience, we also set 

J = sup J(7) = sup /(7(i))^(7l(i) " " -7^(0)^ dt. 
We now establish an asymptotic lower bound on i{{Xi, . . . ,X„}). 
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Figure 3: An illustration some quantities from the proof of Theorem 5. 

Theorem 5. Let f : [0, 1)'^ [0, oo) be L -piecewise constant, and let Xi, . . . , X„ be i.i.d. with 
density f. Then 

liminf n~d£ ({Xi, . . . , X„}) > a.s. 



Proof. Let e > and select j e A with J{'j) > J — ^ . Without loss of generality, we may 
assume that j'{t) > for all t G [0, 1]. Let si, . . . , denote the k < dL times at which 7 
intersects the set 

a 

Set So = and s^^i = 1. For j = 0, . . . ,k set Ij = [sj, Sj+i) and 

Rj = {xe [0, l)*^ : j{sj) ^x< 7(s,+i)}. (3.3) 
For every j we have Rj C QL,a for some a. Recalling the definition of J (1.3) we have 

k k 

j{i) = T. j fm)km---my^dt=j2fhi^j)t' [ {m---m)'^dt, (3.4) 



i=o 



where the second equality follows from the fact that / is constant on Rj C QL,a- Applying 
the generalized Holder inequality to (3.4) we have 



k d / \ d k 

7=0 i=l V^J / 1=0 



fiiis,))-^\Rj\-'- 



Setting pj = Jj^ f{x) dx = f{'y{sj))\Rj\ we have 



fe-i 



j<j{i) + -<J2p! + 



(3.5) 
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Fix _7 G {0, . . . , k}. Let rij denote the number of points from Xi, . . . , Xn falling in Rj and 

set 

ej{n)=i{{Xi,...,Xn}r)Rj). (3.6) 

Then rij is Binomially distributed with parameters n and pj. If / is identically zero on Rj 
then ij{n) = with probability one for all n, and pj = 0, hence 

1 1 

n dij^n) = Cdpf a.s. (3.7) 

If / is not identically zero on Rj, then since j'{t) > for all t, we have \Rj\ > and hence 
Pj > 0. The conditional law pj := pj^ ■ f ■ XR, is then uniform on Rj. Let ii, . . . , iuj be the 
indices of the iij random variables out of Xi, . . . , Xn that belong to Rj. Let "i/ : Rj ^ [0, l)'^ 
be the injective aflfine transformation mapping Rj onto [0, 1)"^. Then ^'(Xj^), . . . , "^[Xi^ , ) are 

independent and uniformly distributed on [0, 1)'^. By [6, Remark 1], we have 

n7^£({*(X,J,...,*(X,„.)}) ^c<i a.s. 
Since ^' preserves the partial order ^, we have by (3.1) that 

tjin) = I ({X,, . }) = i (mXn), . . . , *(Xi„, )}) . 
Since n~^nj — >■ pj almost surely we have 

1 —1 1 i 

n~dij[n) = n-'^{rr^nj)dij{n) ^ CdPj a.s. (3.8) 
Combining this (3.5), (3.7) and (3.8), we see that 

k k ^ 

3 ^ ij (n) Cd ^ pj >CdJ-e a.s. (3.9) 

j=0 j=0 

Since 7 is a monotone curve (i.e., 7'(i) > 0), we can connect the longest chains from each 
rectangle Rj together to form a chain in [0, 1)*^. It follows that 

k 

e{{Xi,...,Xn})>J2ej{n). (3.10) 

j=0 

Combining this with (3.9) we have 

liminf n~d£ ({Xi, . . . , X„}) > CrfJ — £ a.s. □ 

n— >-oo 

For the proof of the upper bound, we need to introduce some new notation. Let ki be an 
integer and set Ax = 1/ki. Let /c2 be another integer and set Ay = Ax/k2. For given ki,k2, 
we say that a sequence of multiindices b = {bj)j^'^ C N'^~^ is admissible if 61 ^ • • • ^ 6^^ 
and ||fej||oo < kik2 for all j. We denote the set of admissible multiindices by $(fci,/^2)- For 
b G ^{ki,k2), define z^.^, z^^i, . . . , z^^ki in [0, 1]'' by Zb,o = Od and z^j = (bjAyjAx) for 
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Figure 4: An illustration of the qviantities Rhj-^ ^h.j, QL,a and 7b in two dimensions with 
b = (bi, 62, ^3, ^4) = (7, 7, 10, 11). In this case, the unit square is partitioned into four squares, 
Ql,{i,2)j Ql,{2,i) and Ql,{2,2)i which are separated by dotted lines in the figure. 



j > 1. Since b is admissible, Zb,0) • • • , -2b,fci defines a chain in [0, 1]"^. Define 7b : [0, 1] — >■ [0, l]'^ 
to be the polygonal curve connecting the points Zb,Oj ■ ■ ■ , 2b,fei, i.e., 

7b(i) = z^,j-i + ^(^bj- - ^bj-i)(i - (i - l)Ax) 

for t e [{j - l)Ax, jAx]. For b G ^{h, ^2) and 1 < j < h, set 

Rbj = |x G [0, 1)'' : Zbj-i - (ld-i,0)Ay ^x< Zb,j} ■ 

For each rectangle Rh,j, we set pbj = /r^^ . fix) dx. We say that a chain xi ^ X2 ^ ■ ■ ■ Xm 
in [0, l)'^ is h-increasing if 

{xi,...,Xm} C IJ i?b,j- 

It is not hard to see that for any ki,k2, every chain in [0, 1)"' is b- increasing for some b G 
^2). See Figure 3.1 for an illustration of the above definitions. 
We first need a preliminary lemma which bounds the length of the longest chain within 
the narrow strip 

T, := [0, if-' X [(i - I) Ax, j Ax), (3.11) 

for any j £ {1, . . . ,ki}. We note that the following lemma is a generalization of [14, Lemma 
7] . The proof is based on the same idea of using a mixing process to embed Xi, . . . , Xn into 
another set of i.i.d. random variables that are uniform when restricted to the strip Tj. 
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Lemma 4. Let f : [0, l)'^ [0, oo) be L-piecewise constant, and let Xi, . . . , Xn be i.i.d. with 
density f. Fix an integer j G {1, ... ,ki} and let < Ax < \\f\\~l^^^Q -^yy Then 

1 

limsupn-3£({Xi,...,X„}nT,) <Cd(2Ax||/||^oo((o,i)d))' a.s. (3.12) 

Proof. Set M = ||/||Loo(-(o^i)£i) and let = / + (M — /) • XTj- Let Yi, ...,¥„ he i.i.d. according 
to the conditional density /3~^(M — /) • XTj where /? = M — f{x) dx. Let mi, . . . , be 
Bernoulli zero-one random variables with parameter (1 + /3)^^ and set 

ik = mi-\ h nik- (3.13) 

Define Z\,. . . ,Zn through the mixture process 

Zk = rukXi^ + (1 - mk)Yk. 

Then Zi, . . . , Zn arc i.i.d. with density (1 + P)~^g. Let W denote the cardinality of the 
set {Zi, . . . , Zn} n Tj. Then is binomially distributed with parameters n and p := {1 + 
P)~^AxM. Since is constant on Tj, we can use a similar argument to that in Theorem 5 to 
show that 

n-h{{Zi,...,Zn}nTj)^Cdp'd a.s. (3.14) 

Let m = in and note that 

I ({Xi, . . . , Xm}) = i {{Zk : mk = l}nTj)<e{{Zi,..., Zn} n Tj) , 
and that p < AxM. Combining this with (3.14) we have 

\imsupn~h{{Xi,...,Xm}) <CdiAxM)^ a.s. (3.15) 



Since m is Binomially distributed with parameters n and {1 + P) ^, we have nm -"^ — >■ 1 + ^ 
almost surely and hence 

limsupm~d^ ({Xi, . . . ,Xm}) = limsup {nm~^)dn~d£ {{Xi, . . . ,X^}) 

n—^oc n— >-oo 

< (1 + /5)3cd(AxM)3 a.s. 

Since /3 < AxM < 1 we have 

limsupm"3^({Xi,...,X^}) < Cd(2AxM)a a.s. 

n->oo 

The desired result (3.12) follows from noting that n i— t- m{n) is monotone nondecreasing along 
every sample path and m — >■ oo as n — >■ oo with probability one. □ 

The following short technical lemma is essential in the proof of Theorem 6 

Lemma 5. Let f : [0, 1)'^ [0, oo) be L -piecewise constant. For every £ > and ki > L we 
have 

J]pt<J + £. (3.16) 

for all b G ^{ki,k2), the admissible multiindices, and k2 > C'||/||Loo((o,i)'i)^i^^/£°'; where 

= {j : Rh,j C QL,a for some a}. (3-17) 
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Proof. Let ki,k2,e > 0, and b G ^{ki,k2). Set Ij = [{j — I) Ax, j Ax) and fix t G Ij. Note 
that 

(Ay'^-^AxUtlihi - bj-i,i + 1) if i > 2 
\Ay''-^AxUtl{bj,i - bj-i,i) if j = 1, 



d-l 



and 

AxS(,,i(t) • • • 7b,d(i) = Ay'-' Ax l[ib,, - 

i=l 

where we set bo = for convenience. A short computation shows that 

|Ax(7[,,i(t)---7M(t))^ -|^b,,l^l <CAxUy^, (3.18) 
where C = (d — 1)3. Since / is L-piecewise constant we have 

/(7b(t)) = /K,-i) = ^, (3.19) 

for all j G Hb and t e Ij. Noting that Ax = \Ij\ and recalhng the definition of J (1.3) we 
have 

(3-18) .... 



(3 18) 1 f' 

J>Jilb) > ^ ^ / /(7b(i))^(|i2b,i|3-CAx3Ay3) 

1 



(3.19) ...^ 1 1 d-i 1 

> E< -Il/Ill-((0,1W'^/ ^2^- (3-20) 

Taking k2 > (C'/£)''||/||loo((o,i)'*)^i~^ completes the proof. □ 
We now estabhsh an asymptotic upper bound on £ {{Xi, . . ., Xn}). 

Theorem 6. Let f : [0, l)"' [0, oo) be L -piecewise constant, and let Xi, . . . , X„ be i.i.d. with 
density f. Then 

limsupn~d£(|Xi, . . . ,X„}) < CrfJ a.s. 

n—^OD 

Proof. Let k2 > 0,ki > L,e > 0, and b G ^{ki, /C2). We suppose that fei > L is a multiple of 
L so that / is /ci-piecewise constant. Let £b{n) denote the length of the longest b-increasing 
chain. Let Uj denote the number of Xi, . . . ,X„ that belong i?b,j and set 

ihAn)=ii{Xi,...,Xn}nRb,j). (3.21) 

Due to the monotonicity of zy^^, . . . , z\j^ki, at most (d — 1)L of Rh,i, ■ ■ ■ , Rb,ki can have a 
non-empty intersection with more than one hypercube QL,a- It follows that < (d— 1)-L, 
where = {1, . . . , ki} \ Hh- 
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Since each b-increasing chain is the union of chains in -Rb,i) ■ ■ ■ ) -^b./ku we have 

ki 

4(n) < ^4j(n) = Yl ^bj(n) + Yl ^bj(n). (3.22) 

i=i jeH^ jG-Hb 

We will deal with each of the above sums separately. For the first term, set M = ||/||Loo((-o.i)d) 
and let ki be large enough so that Ax < 1/M. Since R^j C Tj for each j, we have by Lemma 
4 that 

limsupn"3 V 4 j(n) < c<i|W^|(2AxM)3 < Cd(d - l)L{2M)h~^ a.s. 



Choose ki large enough so that 



limsupn ^ ^hjin) < ^ a.s. (3.23) 



b 



We now bound the second sum in (3.22). By Lemma 5, choose k2 = k{M, ki,e) so that 

for all b € $(^1,^2). For any j € "Hb? the conditional density pj on -Rbj is uniform. By a 
similar argument as in the proof of Theorem 5, we have that 

_i 1 
n di^j{n) CdP^ j a.s. 

Combining this with (3.22), (3.23), and (3.24) we have 

lim supn~ d ^b (?^) < CrfJ + £ a.s. (3.25) 

n— >oo 

Since every chain in Xi, . . . ,Xn is b-increasing for some b G ^(fci, ^2), we have 

i{{Xi,...,Xn})< max 4(n), 
be*(fei,fe2) 



for every n. It follows that 



limsnp £{{Xi, ... ,Xn}) < CdJ + s a.s. □ 



3.2 Continuous densities on Q 

We now generalize the convergence results on piecewise constant densities, Theorems 5 and 
6, to continuous densities on Q. Our main result. Theorem 1, is proved at the end of the 
section. The idea of our approach is to divide [0, 1)^ into a large number of hypercubes, and 
to flatten / on each sub-cube. We can then apply the results from Section 3.1 and take the 
limit as the size of the sub-cubes tends to zero. In order to pass to the limit, we apply the 
perturbation result given in Lemma 3. 
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Let Xi, . . . , Xn be i.i.d. with density /. We recall that Un{x) denotes the length of a 
longest chain among Xi, . . . , Xn consisting of points less than or equal to x under the partial 
order ^. In other words 

Un{x) = e{{Xi : Xi^x}). 
We also recall the definition of the value function U, defined in (1.4) by 

Uix) = sup /' f{lit))Hl'i{t) ■ • -7^(0)^ dt. 
jeA-.^Sx Jo 

We now establish pointwise asymptotic upper and lower bounds on Un- 

Theorem 7. Let f : ^ R satisfy (HI) and let C M| satisfy (H2). Then for every 
z we have 

\iia.su'pn^dUn{z) < CdU{z) a.s. (3.26) 

n—^oo 

Proof. Set D = {x ^ : ^ x < z} and P = f{x) dx. Suppose that p = 0. It 
follows from (HI) that / is lower semicontinuous, and hence f{x) = for x ^ z. Thus 
Uniz) = = U{z) almost surely. 

Suppose that p> and let e > 0. Let k and partition D into fc'' hypercubes Qk,a for 
multiindices a with ||q;||oo < k. Define fk ^ [0, oo) by 

fkix) = ^ ( sup f^XQk.ci^) + fix)XRd\D{x), (3.27) 

and set pk = jjy fk{x) dx. For every integer k, fk is A:-piecewise constant on D and f < fk- 
Define Ufe : M*^ ^ M by 

Vk{x)= sup C fk{l{t))ii{n[{t)---iS))~'dt. (3.28) 

Note that the sequence fk is uniformly bounded, Borel measurable, and has compact support 
in [0, l]*^. Furthermore, it follows from (3.27) that (2.37) holds for the sequence fk- Hence by 
Lemma 3 we have that Vk ^ U uniformly as A; — > oo. Now fix k large enough so that 

\vk{z)-Uiz)\< -. (3.29) 
Cd 

Set _^ 

X= (^I^Jk{x)dx^ ' ^^'^^^ 

and define g = Xfk- Then Xf < g and we can write 5 as a convex combination of two 
distributions as follows: 

9 = Xf + {g-Xf). 

Let Yi, . . . ,Yn be i.i.d. with density {1 — X)~^ {g — Xf), let mi, . . . , to„ be Bernoulli random 
variables with parameter A, and set 

ij = mi + ■ ■ ■ + nij. 
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Define 

Zj = nijXij + (1 - mj)Yj. 

Then a simple computation shows that Zi, . . . , Zn are i.i.d. with density g. Let W denote the 
cardinahty of {Zi, . . . , Z„} fl D. Since g is /c-piecewise constant on D, we can apply Theorems 
5 and 6 to obtain 

lim W-k {{Zi, ...,Zn]r\D}) = CdP,,Kkiz) a.s. (3.31) 

n->oo 

Note that W is Binomially distributed with parameters n and Xpk, hence n~^VF — >■ Xpk almost 
surely. Applying this to (3.31) we have 

lim n-U({Zi,...,Zn}nD) = lim (n-^W)^W-U ({Zi, . . . , Z^} n D) 

n— >-oo n^oo 

= CdX^Vk{z) a.s. (3.32) 
Set Tfi — iyi- Note that Tfi is Binomially distributed with parameters n and A, and 

Um{z) = i ({Xi, . . . , x^} n L*) < £ ({Zi, . . . , z„} n I?) . (3.33) 
Combining (3.33) with (3.32) and the fact that n~^m ^ A as n ^ oo we have 

1 (3-33) 1 1 

limsupm~d'u^(z) < lim {m~^n)dn~d£[{Zi,...,Zn}nD) 

n-*-oo n-^oo 
(3 32) 

= CdVk{z) a.s. (3.34) 

Recalling (3.29) we have 

\iTn.s\rpm~d.Um{z) < CdU{z) + e a.s. 

n—^oo 

As in the proof of Lemma 4, the proof is completed by noting that n ^ m{n) is monotone 
nondecreasing along every sample path and m — > oo as n — > oo with probability one. □ 

Theorem 8. Let f : ^ R satisfy (HI) and let 9. d satisfy (H2). Then for every 
z we have 

\im.m.in~dUn{z) > CdUiz) a.s. (3.35) 

n-*-oo 

Proof. Let e > 0. As in the proof of Theorem 7, we set D := {x & : ^ x < z} and 
we may suppose that p := f{x) dx > 0. As before, let A; G N and partition D into 
hypercubes Qk,a for multiindices a with ||a||oo < k. Define /fe : M*^ ^ [0, oo) by 

fkix) = XI lA'^^ f)xQk,Jx) + fix)XR'i\D{x), (3.36) 
a 

and set pk = Jj^ fk{x) dx. Define 

"/W>» (3.37) 
I 0, otherwise. 
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For any a such that Qk,a C we have by (HI) and (3.36) that 

fk{x) > f{x) - m j ^ ^ 

It follows that ||9||i:oo(]Kd) / 1 as /c — >■ DO. As in the proof of Theorem 7, we have that Vk ^ U 
uniformly as A; — >■ oo, where is defined by (3.28). We can therefore fix k large enough so 
that 

_ 1 

Cd\\q\\L^(^f.dfk{z) > CdU (z) - £. (3.38) 

For each i, let rrii be a Bernoulli zero-one random variable with parameter ||Q'||^<i^]g<ij?(-^i). 
Let m = mi + • • • + m„ and let ii, . . . , denote the indices for which = 1. We claim that 
Xi^, . . . ,Xi^ are i.i.d. with density g := Xfk where A is defined in (3.30). To see this, first 
note since f{x) = implies fk{x) = 0, we have q{x)f{x) = fk{x) for all x G W^. Thus 

P{mi = l)= [ Pimi = l\Xi = x)f{x)dx= [ ^/(x)dx = — (3.39) 

J^d \\q\\ X\\q\\ 

where \\q\\ = \\q\\L'>={R'iy Let j > I and let ^ C M*^ be measurable. We have 

P{Xi. eA) = P{Xi eA\mi = l) 

_ P{Xi e A and rrii = 1) 
~ P{mi = 1) 

(3_^9) ^ii^ii / p(^^. = i^Xi = x)f{x) dx 
J A 

= A|k|| / f^f{x)dx 

Ja \m\ 

= / Xfk{x)dx. 

J A 

By the construction of Xj^, . . . , Xi^, they are independent random variables, hence the claim 
is established. 

Let W denote the cardinality of {Xi^, . . . ,Xi^} fl D. By Theorems 5 and 6, we have 

\imW-"u{{Xi„...,Xi^}nD) = CdPl''vk{z) a.s. (3.40) 

n— >-oo 

Define 

{1, if mj = 1 and Xi & D 
0, otherwise. 

Then W = wi + ■ ■ ■ Wn- Each Wi is a Bernoulli zero-one random variable with parameter 
P{wi = 1) = P{mi = 1 and € I?) = / P{mi = l\Xi = x)f{x) dx = p- 

Jd WqW 

It follows that W is Binomially distributed with parameters n and ||g||~^Pfe, and hence 
n~^W \\q\\~^Pk almost surely. Combining this with (3.40) yields 

lim n-U{{Xi„...,Xi^}nD)= lim {n-^W)'dW-U {{Xi„ . . . ,XiJ n D) 

n— >oo n— ^-oo 

= Cd\\q\\~^Vk{z) a.s. (3.41) 
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Noting that 

Un{z)=l{{Xi,...,Xr,]r\D)>l{{Xi,,...,XiJf\D), 

we have 

liminf n~3u„(2;) > Hm n~^^{{Xi,,...,Xi\f^D) 

n—^oo n— >-oo 

^^=^ Cd\\q\\-'dvk{z) a.s. (3.42) 

Recalhng (3.38) we have 

liminf n''dUn(z) > cJJiz) — e a.s. □ 

n^oo 

We now have the proof of Theorem 1. 

Proof. Let e > 0. Let A; G N and for a multiindex a G Z'^, set Xa = ajk. Since U is uniformly 
continuous (by Lemma 1) we can choose k large enough so that 

|[/(x«+iJ-C/(xa)| < - (3.43) 

for all a G Z*^. Let / be the set of multiindices a for which G [0, 1]*^. Note that the 
cardinality of / is (fe + I)"'. Since / is finite with cardinality independent of n, Theorems 7 
and 8 yield 

lim sup |n~d'u„(a;Q;) — Cd?7(a;o!)| = a.s. (3.44) 

as/ 

Let z G (0, l]''. Then there exists a G / such that < z Xq+i^. By the Pareto- 
monotonicity of and (3.43) we have 

_i _i (3.43) _i 

n dUn{z) - CdU{z) < n dUn{Xa+la) - CdU{z) < n dUn{Xa+la) - CdU{Xa+lj^) + £■ 

By a similar argument, we have 

n~^Un{z) - CdU{z) > n'^UniXa) - CdU{Xa) - £, 

and hence 

Wn'dUn - CdU\\L^(^(Q^l)d) < SUp\n~dUn{Xa) - CdU{Xa)\ + s. (3.45) 

Combining (3.44) and (3.45) we have 

limsup Wri'dUn — CdC^||L°°((o,i)'*) — ^ 

n^oo 

and hence lim^^oo \\n~dUn — C(iC/||2,oo((o,i)<i) = almost surely. The desired result now follows 
immediately from the boundary conditions on U proved in Theorem 2 (i), (ii) and the fact 
that there are almost surely no samples in M'^ \ (0, l)'^. □ 
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As a straightforward application of Theorem 1, we can show that non-dominated sorting 
is stable under bounded random perturbations in the samples Xi, . . . , X^. For 6 > 0, we set 

Zi = Xi + YiS for i = 1,. ..,n, 

where Yi, . . . , are i.i.d. with a continuous compactly supported density function : M'' ^ M. 
For X G W^, set 

ui{x)=£{{Zi : Zi^x}). 

Theorem 9 (Stability of non-dominated sorting). Let / : R'^ — R satisfy (HI) and let 
Q C M!^ satisfy (H2). There exist constants Cs, depending only on 5, f , and g, such that 

limsupn Ip^ — 'u„||ioo(]Kd) < Q a.s. 

n— >-oo 

and — >■ as 5 — > 0. 

Proof Set g5{x) = ^g{^). Then Zi, . . . , Zn are i.i.d. with density fs ■= gs * f- Set 
U\x) = sup fs{l{t))Hl'i{t)---ldit))-^dt. 

Without loss of generality, we may suppose that C (0, l)'^. Since supp(/) C 0, and g has 
compact support, we can take S > small enough so that supp(/5) C [0, l]'^. Let 5k be a 
sequence such that (5fc — >■ as A; — >■ oo. It is not hard to see that (2.37) holds for the sequence 
fSf,. By Lemma 3, we have that U^'' — t- U uniformly as A; — t- oo, where U is the value function 
defined by (1.4). Therefore ^ U uniformly as (5 ^ 0. Note that 

n d\\u^- UnWi'^iSid^ < \\n du^-CdU ||Lcx>(Rd) -|- ||n dUn - CdUW^oof^-^d-^ + Cd\\U - ?7||£,^(u.d), 

for every n. Since fs is continuous on (0, 1)"^ and fsix) = for x (0, l)'', (HI) is satisfied 
for fs by taking Q' = {0,lf. We can therefore apply Theorem 1 to obtain 

_i g g _i 

\\n du^-CdU \\ LOO Q^d) + \\n dUn- CdU\\Loo(^d) ^ a.s. 

The proof is completed by setting Cs = Cd\\U^ — U\\Loo(^^dy □ 

4 Numerical demonstrations 

Theorem 1 guarantees that the level sets of CdU will provide good approximations to the 
Pareto fronts for large n. In this section, we present a numerical scheme for computing U 
and show examples comparing the level sets of CdU to the Pareto fronts for various density 
functions. To compute U, we need to compute the Pareto-monotone viscosity solution of 

U.,---U., = llf on M^, (4.1) 

that satisfies C/ = on dW^. Let [/„ and /„ denote the values of U and / on a grid with 
spacing Ax, where o; is a multi-index. For a given grid point a, the domain of dependence for 
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(4.1) is {/? : /3 ^ a}. Hence an upwind scheme will use backward difference quotients. Now 
consider substituting backward difference quotients into (4.1). We have 

UiUa - Ua-eJ = ^fa- (4.2) 
i=l 

We intend to solve the above equation for Ua in terms of Ua-a ■ Since we intend to compute 
the Parcto- monotone solution of (4.1), we should look for a solution with Uq, > Ua-a for all 
i. Consider the mapping 

d 

i=l 

where Ui > for all i. Note that this mapping is strictly increasing for p > max(ai, . . . ,0^^) 
and HiLilP ~ di) = for p = max(ai, . . . , a^). Hence, for any non-negative qq, . . . , aa, there 
exists a unique p > max(ai, . . . , aa) satisfying 

d 

JJ(p- Oj) = ao- 

i=l 

We denote this solution p by P{ao, ■ ■ ■ , a^) and define our numerical scheme by 

[/„ = P{/^x''fJd\ Ua-e^ Ua-e,) (4.3) 

with the boundary condition Ua = for a with min(Q;i, . . . , a^) = 0. The numerical solution 
can be computed by any sweeping pattern respecting the partial order ^. This requires visiting 
each grid point exactly once, and hence has linear complexity. The value of P(ao, . . . , a^) can 
be computed numerically by either a binary search and/or Newton's method restricted to the 
interval [max(ai, . . . , 0^;), max(ai, . . . , a^) + cLq'^]. In the case of c/ = 2, we have a closed form 
expression for P 

P(ao, 01,02) = -(ai + 02) + -^(ai -a2)^ + 4ao. 

Note that we have chosen the positive square root to obtain the Pareto-monotone solution. 
We intend to prove, in a subsequent paper, that the numerical solutions, defined as above, 
converge to the unique truncatable Pareto-monotone viscosity solution of (4.1) as Ax — )• 0. 

For d = 2, we have C2 = 2, hence the level sets of U will approximate the Pareto fronts, 
where UxUy = f. We now show examples of Pareto fronts alongside the level sets of U 
for Xi, . . . ,Xn sampled according to different density functions. In Figure 5, we consider a 
uniform density function on the gray region in the top left of Figure 5, and show the Pareto 
fronts for n = 10^, n = 10^ and n = 10^ independent samples alongside the corresponding level 
sets of U. Observing the Figure, we see that the Pareto fronts are well approximated by the 
level sets of U for large n. We also notice that the level sets of U appear to yield a consistent 
underestimate of the Pareto fronts. Bollobas and Brightwell [5] showed that the normalized 
expectation of the longest increasing subsequence among n points chosen independently from 
the uniform distribution on [0, 1]*^ is always bounded above by Cd, which is the limit of these 
normalized expectations as n — t- 00. In light of this result, our observation is not surprising 
and merely confirms the results in [5]. We also observe that although the boundary of O 
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Figure 5: Comparison of the Pareto fronts and the level sets of U, where UxUy = f and / is 
the uniform density on the gray region in the top left. The plots correspond to the Pareto 
fronts computed with n = 10^, n = 10^ and n = 10® independent samples from /. In each 
case, we show 15 equally spaced Pareto fronts and the corresponding level sets of U. 

is smooth, the solution U develops shocks, or kinks, which are visible in the level sets of 
U. In Figure 6, we show the same comparison for a multi-modal density function on [0, 1]^. 
The density function is depicted by the plot in Figure 6 and we have the same expected 
underestimation present here as well. 
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Figure 6: Comparison of the Pareto fronts and the level sets of U, where UxUy = f and / 
is the density depicted by the plot in the top left. The plots correspond to the Pareto fronts 
computed with n = 10^, n = 10^ and n = 10® independent samples from /. In each case, we 
show 15 equally spaced Pareto fronts and the corresponding level sets of U. 
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